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Abstract. We extend the relation between random matrices and 
free probability theory from the level of expectations to the level of 
fluctuations. We show how the concept of "second order freeness" , 
which was introduced in Part I, allows one to understand global 
fluctuations of Haar distributed unitary random matrices. In par- 
ticular, independence between the unitary ensemble and another 
ensemble goes in the large N limit over into asymptotic second 
order freeness. Two important consequences of our general theory 
are: (i) we obtain a natural generalization of a theorem of Diaconis 
and Shahshahani to the case of several independent unitary matri- 
ces; (ii) we can show that global fluctuations in unitarily invariant 
multi-matrix models are not universal. 



1. Introduction 



In Part I of this series |MSp we introduced the concept of second 



order freeness as the mathematical concept for dealing with the large N 
limit of fluctuations of N x iV-random matrices. Whereas Voiculescu's 
freeness (of first order) provides the crucial notion behind the leading 
order of expectations of traces, our second order freeness is intended 
to describe in a similar way the structure of leading orders of global 
fluctuations, i.e., of variances of traces. In Part I we showed how fluc- 
tuations of Gaussian and Wishart random matrices can be understood 
from this perspective. Here we give the corresponding treatment for 
fluctuations of unitary random matrices. Global fluctuations of unitary 



* Research supported by Discovery Grants and a Leadership Support Initiative 
Award from the Natural Sciences and Engineering Research Council of Canada. 

t Research supported by State Committee for Scientific Research (KBN) grant 
2 P03A 007 23, RTN network: QP- Applications contract No. HPRN-CT-2002- 
00279, and KBN-DAAD project 36/2003/2004. The author is a holder of a schol- 
arship from the European Post-Doctoral Institute for Mathematical Sciences. 

t Research supported by a Premier's Research Excellence Award from the 
Province of Ontario. 

1 



2 



J. A. MINGO, P. SNIADY, AND R. SPEICHER 



random matrices have received much attention in the last decade, see, 
e.g, the survey article of Diaconis jD] . 

Our main concern will be to understand the relation between unitary 
random matrices and some other ensemble of random matrices which is 
independent from the unitary ensemble. This includes in particular the 
case that the second ensemble consists of constant (i.e., non-random) 
matrices. A basic result of Voiculescu tells us that on the level of 
expectations, independence between the ensembles goes over into as- 
ymptotic freeness. We will show that this result remains true on the 
level of fluctuations: independence between the ensembles implies that 
we have asymptotic second order freeness between their fluctuations. 

Two important consequences of our investigations are the following. 
% We get a generalization to the case of several independent unitary 

random matrices of a classical result of Diaconis and Shahshahani 
|DSj . Their one- dimensional case states that, for a unitary random 
matrix U, the family of traces Tr(U n ) converge towards a Gaussian 
family where the covariance between Tr(U m ) and Tr (U* n ) is given by 
n ■ 5 mn . In the case of several independent unitary random matrices, 
one has to consider traces in reduced words of these random matrices, 
and again these converge to a Gaussian family, where the covariance 
between two such reduced words is now given by the number of cyclic 
rotations which match one word with the other. This result was also 
independently derived by Radulescu [Rj in the course of his investiga- 
tions around Connes's embedding problem. 

% We can show that we do not have universality of fluctuations in 
multi-matrix models. For unitarily invariant one-matrix models it 
was shown by Johansson [J] (compare also JAJMJ) that many random 
matrix ensembles have the same fluctuations as the ensemble of Gauss- 
ian random matrices. A main motivation for our investigations was 
the expectation that many unitarily invariant models of multi-matrix 
random ensembles should have the same fluctuations as the ensemble 
of independent Gaussian random matrices. However, our theory of 
second order freeness shows that this is not the case. 

The paper is organized as follows. In Section 2, we recall all the nec- 
essary definitions and results around permutations, unitary random 
matrices, and second order freeness. We will recall all the relevant no- 
tions from Part I, so that our presentation will be self-contained. How- 
ever, for getting more background information on the concept of second 
order freeness one should consult |MSp| . In Section 3, we derive our 
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main result about the asymptotic second order freeness between uni- 
tary random matrices and another independent random matrix ensem- 
ble. This yields as corollary that independent unitary random matrices 
are asymptotically free of second order, implying the above mentioned 
generalization of the result of Diaconis and Shahshahani |DSj . Sec- 
tion 4 shows how our results imply the failure of universality of global 
fluctuations in multi-matrix models. 



2. Preliminaries 

2.1. The lattice of partitions. For natural numbers m, n 6 N with 
m < n, we denote by [m, n] the interval of natural numbers between m 
and n, i.e., 

[m, n] := {m, m + 1, m + 2, . . . , n — 1, n} 

and [m] = [l,m]. For a matrix A = (ciij)ij = \, we denote by Tr the 
unnormalized and by tr the normalized trace, 

- 1 
Tr(A) tr(v4) := —Tr(A). 

i=i 

We say that A = {Ai, . . . , A^} is a partition of the set [1, n] if the 
subsets Ai are disjoint, non-empty, and their union is equal to [l,n). 
We call Ai, . . . ,Ak the blocks of the partition A. For a permutation 
7r G S n we say that a partition A is 7r-invariant if tt leaves invariant each 
block Ai. Let l n denote that partition of [n] with one block and V(n) 
denote the partitions of [n\. Given positive integers m and n let l m , n 
be the partition of [m + n] with the two blocks: [m] and [m + 1, m + n] . 

If A = {Ai, . . . , Ak} and 5 = {Bi, . . . , S^} are partitions of the same 
set, we say that A < B if for every block Ai there exists some block Bj 
such that Ai C For a pair of partitions A, B we denote by A V Z? 
the smallest partition C such that A < C and B < C. 

If we are considering classical random variables on a probability 
space, then we denote by E the expectation with respect to the cor- 
responding probability measure and by k r the corresponding classical 
cumulants (as multi-linear functionals in r arguments); in particular, 

ki(a) = E(a) and k 2 (ai, a 2 ) = E(aia 2 ) — E(ai)E(a2). 

If ax, . . . , a n are random variables and C = {Ci, . . . , C^} is in V{n) 
we let 

k 

E c (ai, . . . ,a n ) = TTE( f] a j) 
t=i K ^ J 
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On the lattice V(n) moments to cumulants are related by the Mobius 
function: Mob. In particular the n th cumulant k n is given by 

"nl^l) . . . , <X r )= M6b(C,l r )E c ( Q\ ; ... , (X n J 

CeV(n) 

where M6b(C, 1„) = ( — l) k ~ l (k — 1)! and where k is the number of 
blocks of C . We shall need the following formula for the second cumu- 
lant of the product of random variables, see for example [L, 3.2]. 

(1) k 2 (ai • • -a m ,6i • • -b n ) = ^2 K(a 1: . . . a m ,bi, . . . ,b n ) 

T V 1t7i ? 7i — 1 n 

The sum is over all partitions of [m + n] which have at least one block 
which connects the two blocks of l m ,n- 

2.2. Permutations. We will denote the set of permutations on n el- 
ements by S n . We will quite often use the cycle notation for such 
permutations, i.e., 7r = (ii, . . . , i r ) is a cycle which sends ik to ik+\ 
{k = 1, . . . , r), where i r+ i = i\. 

2.2.1. Length junction. For a partition it G S n we denote by #(vr) the 
number of cycles of tt and by [vr | the minimal number of transpositions 
needed to write 7r as a product of transpositions. Note that one has 

M + #( 7r ) — n f° r & h 17 Sn- 

2.2.2. Non-crossing permutations. Let us denote by 7„ G S n the cycle 

7„ = (l,2,...,n). 

For all 7r G S n one has that 

n — 1 < \n\ + |7 n 7r _1 |. 

If we have equality then we call n non- crossing, see jB] for the basic 
properties of non-crossing partitions. Note that this is equivalent to 

#(7r) + #(7„7r- 1 ) = n + l. 

If tt is non-crossing, then so are 7 n vr _1 and 7r -1 7 n ; the latter is called 
the (Kreweras) complement of it. 

We will denote the set of non-crossing permutations in S n by NC(n). 
Note that such a non-crossing permutation can be identified with a 
non-crossing partition, by forgetting the order on the cycles. There is 
exactly one cyclic order on the blocks of a non-crossing partition which 
makes it into a non-crossing permutation. 
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2.2.3. Annular non-crossing permutations. Fix m, n G N and denote 
by 7 mi „ the product of the two cycles 

lm,n = (1,2, . . . ,m)(m + l,m + 2,...,m + n). 

More generally, we shall denote by 7 mi) ..., mfc the product of the corre- 
sponding k cycles. 

We call a 7r G S rn + n connected if the pair tt and 7m,Ti generates 
a transitive subgroup in S m+n . A connected permutation tt G S m+n 
always satisfies 

(2) m + n < \ix\ + |7 m ,„,7r _1 |. 

If 7r is connected and if we have equality in that equation then we 
call tt annular non-crossing. Note that with tt also 7m in 7r~ 1 is annu- 
lar non-crossing. Again, we call the latter the complement of tt. Of 
course, all the above notations depend on the pair (m, n); if we want to 
emphasize this dependency we will also speak about (m, reconnected 
permutations and (m, n)-annular non-crossing permutations. 

We will denote the set of (m, n)-annular non-crossing permutations 
by SNc{ m , n)- Again one can go over to annular non-crossing partitions 
by forgetting the cyclic orders on cycles; however, in the annular case, 
the relation between non-crossing permutation and non-crossing parti- 
tion is not one-to-one. Since we will not use the language of annular 
partitions in the present paper, this is of no relevance here. 

Annular non-crossing permutations and partitions were introduced 
in pNj : there, many different characterizations — in particular, the one 
(J2J) above in terms of the length function — were given. 

2.3. A triangle inequality. Let {A%, . . . , A^} be a partition of [n]. 
If, for 1 < i < k, Tfi is a permutation of the set A4 we denote by 
7ri x • • ■ x 7Tfc G S n the concatenation of these permutations. We say 
that 71 = tii x ■ ■ • x 7Tfc is a cycle decomposition if additionally every 
factor 7Tj is a cycle. 

Notation 2.1. 1) For A G V{n) we put \A\ := n - 

2) For any tx G S n and any 7r-invariant A G V(n) we put 

\(A,tt)\ := 2L4| - |tt|. 

Lemma 2.2. 1 ) For all A,B G V(n) we have 

\A VB\ < \A\ + \B\ 

2) If n and o are in S n and A,B<E V(n) are n and o invariant respec- 
tively, then 

\(AV B,7ra)\ < \{A, tt)| + \{B, a)\. 
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Proof. 1) Each block of B with k points can glue together at most k 
blocks of A, thereby reducing the number of blocks of A by at most 
k — 1. Thus B can reduce by at most n — #(B) the number of blocks 
of A. Hence the difference between j^{A) and ^(AVB) cannot exceed 
n — #(B) and hence 

#(A)-#(AVB)<n-#(B). 

This is equivalent to our assertion. 

2) We prove this, for fixed it and a by induction on \A\ + \B\. The 
smallest possible value of + occurs when \A\ = \n\ and \B\ = \a\. 
But then we have (since A\/ B > na) 

2\AVB\ - \na\ < \AV B\ < \A\ + \B\ by (1) 

which is exactly our assertion for this case. For the induction step note 
that we have just shown that 

2\AV B\ - \ir<r\ < 2\A\ - [vr| +2(51 - \a\ 

when \A\ = \tt\ and B\ = \o~\. Now one only has to observe that if one 
increases \A\ (or \B\) by 1 then | A V B\ can also increase by at most 
1. □ 

2.4. Haar distributed unitary random matrices and the Wein- 
garten function. In the following we will be interested in the asymp- 
totics of special matrix integrals over the group U(N) of unitary iV x iV- 
matrices. We always equip the compact group U{N) with its Haar 
probability measure and accordingly distributed random matrices we 
shall call Haar distributed unitary random matrices. Thus the expec- 
tation E over this ensemble is given by integrating with respect to the 
Haar measure. 

The expectation of products of entries of Haar distributed unitary 
random matrices can be described in terms of a special function on the 
permutation group. Since such considerations go back to Weingarten 
|W] , Collins [C] calls this function the Weingarten function and denotes 
it by Wg. We will follow his notation. In the following we just recall the 
relevant infor matio n about this Weingarten function, for more details 



we refer to plCSllXj. 

We use the following definition of the Weingarten function. For 

7r G S n and iV > n we put 

Wg(iV, vr) = E(U n --- U nn U Ml) ■ ■ ■ U nn(n) ), 

where U = {Uij)fj =1 is an iV x iV Haar distributed unitary random ma- 
trix. Sometimes we will suppress the dependence on iV and just write 
Wg(7r). This Wg(iV, ir) depends on 7r only through its conjugacy class. 
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General matrix integrals over the unitary groups can be calculated as 
follows: 

(3) E(C/^v • • • Vi'j'JJi xix ■ ■ ■ U injn ) 

= > <5i,?' '"Si i> S~.~i ■ ■ ■ Sa ji Wg(/3a _1 ). 

The Weingarten function is a quite complicated object, and its full 
understanding is at the basis of questions around Itzykson-Zuber inte- 
grals. For our purposes, only the behaviour of l eadin g orders in N of 
Wg(N, 7r) is important. One knows (see, e.g., 00) that the leading 
order in 1/N is given by \tt\ + n and increases in steps of 2. 

Let us use the following notation for the first two orders (n G S(n)): 

Wg(iV,vr) = / u( 7 r)iV- ( M+™) + 0(7r)jV- (W+n+2) + 0(iV~ (|7r|+n+4) ). 

One knows that /i is multiplicative with respect to the cycle decom- 
position, i.e., 

M 7 ^ x 7r 2) = AiOi) ' M 7 ^)- 
The important part of the second order information is contained in 
the leading order of Wg(7ri x 7r 2 ) — Wg(7Ti)Wg(7r 2 ), which is given by 

y U 2 (7T 1 , 7r2 )AT-(kil + k2|+m+n+2) for ^ £ ^ and ^ £ ^ &nd where 
^2(^1, ^2) := 0(tTi X 7T 2 ) - /x(7Ti)0(7r 2 ) - 0(7Ti)/i(7T 2 ). 

Note that we have 

^2(^1,^2) = /i2(vr 2 ,7Ti). 
Collins [0] has general counting formulas for the calculation of \x and \xi 
(and also higher order analogues); however, a conceptual explanation 
of fj, 2 seems still to be missing, fi is the Mobius function of the lattice 
of non-crossing partitions (thus determined by Catalan numbers), and 
this fact is quite well understood by the relation between \i and asymp- 
totic freeness of unitary random matrices. In a similar way, one should 
get a conceptual understanding of /z 2 by the relation with second order 
freeness. In the present paper we will not pursue further this direction, 
but we will come back to it in forthcoming investigations. Here we will 
not rely on the concrete values of // or // 2 , but will only use the basic 
properties mentioned above. 

2.5. Second order freeness. In |MSp , we introduced the concept 
of second order freeness which is intended to capture the structure 
of the fluctuation functionals for random matrices arising in the limit 
N — > 00, in the same way as the usual freeness captures the structure 
of the expectation of the trace in the limit. We recall the relevant 
notations and definitions. 
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Definition 2.3. A second order non- commutative probability space (A, 
¥>i> fz) consists of a unital algebra A, a tracial linear functional 

ipi : A — > C with ip(l) = 1 

and a bilinear functional 

p 2 ■ A x A -> C, 
which is tracial in both arguments and which satisfies 
<^ 2 (a, 1) = = (/9 2 (1, 6) for all a, b G A. 

Notation 2.4. Let unital subalgebras A\, . . . ,A r C .A be given. 

1) We say that a tuple (ai,...,a n ) > 1) of elements from A is 
cyclically alternating if, for each fc, we have an i{k) G {1, . . . , r} such 
that afc G Ai(k) and, if n > 2, we have i{k) ^ for all k — 1, . . . , n. 
We count indices in a cyclic way modulo n, i.e., for k = n the above 
means 7^ z(l). Note that for n = 1, we do not impose any condition 
on neighbours. 

2) We say that a tuple ( CLl , . . . , CL n ) of elements from A is centered if we 
have 

^i(afc) = for all k — 1, . . . , n. 

Definition 2.5. Let {A,<pi,<p2) be a second order non-commutative 
probability space. We say that unital subalgebras A\, . . . , A r C A are 
free with respect to (<px, <p 2 ) or free of second order, if they are free (in 
the usual sense [VDN ) with respect to (fx and if the following condition 
for cp 2 is satisfied. Whenever we have, for n,m > 1, tuples ( 
and (b m , . . . ,bi) from A such that both are centered and cyclically 
alternating then we have 

(1) If n ^ m, then 

if 2 {ai ■ ■ -a n ,b m ■ ■ -bi) = 0. 

(2) If n = m — 1 and a G A4, b G Aj, with i 7^ j, then 

<f 2 (a,b) = 0. 

(3) If n = m > 2, then 

V? 2 (ai • • • a n , b n ■ ■ ■ bi) = ^ <fi(aibi +k ) ■ (pi(a 2 b 2+k ) ■ ■ ■ ^i(a n 6 n+fc ). 

k=0 

For a visualization of this formula, one should think of two concentric 
circles with the a's on one of them and the 6's on the other. However, 
whereas on one circle we have a clockwise orientation of the points, on 
the other circle the orientation is counter-clockwise. Thus, in order to 



FLUCTUATIONS OF UNITARY RANDOM MATRICES 9 

match up these points modulo a rotation of the circles, we have to pair 
the indices as in the sum above. 



Recall that in the combinatorial description of freeness NSp , the 
extension of (pi to a multiplicative function on non-crossing partitions 
plays a fundamental role. In the same way, second order freeness will 
rely on a suitable extension of <^2- 

Notation 2.6. Let (A.,(pi,(p2) be a second order non-commutative 
probability space. Then we extend the definition of tpi and </? 2 as fol- 
lows: 

oo 

<P! :{J{S n x A n ) -> C 

n=l 

(-7T, oi, . . . ,a n ) h-> yji(7r)[ai, . . . ,a„] 
is, for a cycle 7r = (ii, z 2 , • • • , v), given by 

<pi(7r)[ai, . . .,a n ] := <px{a h a i2 a i3 ■ ■ ■ a ir ) 
and extended to general 7r G 5„ by multiplicativity 

V?i(tti x 7r 2 )[ai, . ..,a n ] = <pi(7Ti)[ai, . . . , a n ] • <pi(7T 2 )[ai, . . . ,a n ]. 
In a similar way, 

oo 

<^2 : |J (S m ><S n X A m X X') -> C 
m,n=l 

(7ri, 7r 2 , ai, . . . , a m , h, ... , b m ) i ► ^2(^1, 7T 2 )[ai, . . . , a m ; 6 X , . . . , 6 n ] 

is defined, for two cycles ~K\ = (ii,i 2 , • • • , ip) and 7r 2 = (ji, j 2 , . . . ,j r ), 
by 

^2(7Ti,7r 2 )[ai, . . .,a m ;bi, . . .,b n ] : = ^(a^a^ • • ■a ip ,b jl b j2 ■ ■ - b jr ) 
and extended to the general situation by the derivation property 

(4) y? 2 (7Ti x 7r 2 ,7r 3 )[ai,...,a m ; &i,...,&„] 

= ^2(7ri,7T3)K, .. .,a m ;6i, ...,&„] • ^i(7r 2 )[ai, ...,a m ,bi,.. . ,b n ] 
+ V2(7r2,7r 3 )[ai, . . . , a m ; &i, . . . , 6 n ] • <£>i(7Ti)[ai, . . . , a m , &i, . . . ,&„]. 

and 

(5) ^(vri,^ x 7r 3 )[ai,...,a m ; &!,...,&„] 

= ^2(^1,^2)^1, • ■ • ,a m ;6i, . . . A] • <pi(7T 3 )[ai, . . . , a m , h, ...,b n ] 
+ ^2(7Ti,7r 3 )[ai, . . . ,a m ;6i, . . . ,b n ] ■ ^1(^2)^1, • • • ,a m ,&i,.. .,&„]. 
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Remark 2.7. Let (Aj) ie i be a family of unital subalgebras of the sec- 
ond order probability space (A, <pi, (p 2 ) which are free of second order. 
Suppose that for each i we have (5jj) je ^. a family of unital subal- 
gebras of Ai which are free of second order. By |VDNj Prop. 2.5.5 
(hi)] (Bi^j^Ki are free of first order. We leave as an exercise for the 
reader to show that the proof of |VDN| can be adapted to show that 
{Bij)j e \jiKi are free of second order. 

3. Asymptotic second order freeness for unitary random 

matrices 

Notation 3.1. Suppose e : [21] — > { — 1,1} is such that Ylf=i e « = 0- 
We write e _1 (l) = {pi,p 2 , • • -,Pi} and e _1 (-l) = {qt,q 2 , • • •,?/}, with 
Pi < p 2 < ■ ■ ■ < Pi and qi < q 2 < ■ ■ ■ < qi- Let S% be the permutations 
Ti in S 2 i such that 7r takes {pi, . . . ,pi} onto {gi, . . . , q{\ and vice versa. 
Given a it in S%f we may extract a pair of permutations a n and (3 n in 
Si from the equations 

(6) ^(Pa v (k)) = Ik and vr(g fc ) = p Mk) 

and conversely: (a, (3) i— > 7r Q / g. Thus we have a bijection of sets between 
and Sj x Si. 
Given tr G S^z we let 7f G Si be defined by 

71-2 (Pfc) = Pfr(Jfc) 

Note that 7f a)( g = 
Also we have 

#W = #(*), 

and thus 

I 71 "! = 1^1 + 

Lemma 3.2. Fix I G N and 7 G S^z- £e£, /or iV G N, U be a Haar 
distributed unitary N x N random matrix. Let e : [2/] — > { — 1, 1} such 
that J2i=i e i = 0- Then we have for all 1 < r±, . . . , r 2 i, s\, . . . , s 2 i < N 
that 

21 

(7) E(^ jS7(1) • • • U^J =J2U W«) W S(N, ff). 
Proof. Let ik,i'k, jk, j'k (1 < k < I) be such that 
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i.e. let e _1 (l) = {pi, ■ ■ ■ ,pi} with p\ < ■■■ < pi and e _1 (— 1) = 
{Qi, ■■■,Qi} with q x < ■ ■ ■ < q x and i' k = r Pfc , j' k = s 7(Pfe) , i k = s j{qk) , and 

Jk — r q k - 

Now suppose that a and (3 in Si and n G S^f is as in equation © 
above. 

Thus we have 

ik = Sj(q k ) = S 7MP Q (fc)))> an d i'a(k) = r p a(fc) ) 

and 

which shows that 



and 
Thus 

Hence 



^fc — Z a (fc) ^ ^ r p Q(fc) — S 7(^(P Q (fc))) 

Jfc = j/3(fc) ^ gfc = S 7(T(9fc))- 

i 21 

fc=i fc=i 



e(^ w • • • t^u J = E fe • • • ^re* • • • ^i) 

= > <L»' 5,-!,-' •••5, Wg(/3a _1 ) 



2/ 



II^.-7w fc )) w e( f )- 



(<0 k=l 



□ 



We can now address the question how to calculate expectations of 
products of traces of our matrices. The following result is exact for 
each N; later on we will look on its asymptotic version. 

Note that the notation Tr n (Di, . . . , D n ) for 7r G S n is defined in the 
usual multiplicative way, as was done in Notation 12.61 for ipi. 

We shall need the following standard lemma. For Di,...,D p G 

M N (A) let the entries of A be (Z>§). 



Lemma 3.3. Let n G S n and D\, . . . , _D n G Mn(A). Then 

.7™ J7r(n) 



»„)= V D<I», (1) ^l (2) ...flf 



JU2,-Jn 
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Given mi, ... , m^, let 7 mi ,..., mjfc be the permutation of [mi + • • • + m k ] 
with /c cycles where the i th cycle is (mi+- • -+mj_i + l, . . . , mi+- • •+m i ). 

Proposition 3.4. Fix m 1: . . . , m k G N such that m\ + h m k — 21 

is even. Let, for fixed N GN, U be a Haar distributed unitary N x N- 
random matrix and Di, . . . , D 2 i be N x N -random matrices which are 
independent from U. Let e : [2/] — > { — 1,1} with Ylf=i e i = 0- 
7 = 7mi,...,m t ■ Then 

(8) E(Tr(D 1 f/ ei .--A ni f/ e '"i) 

x IV( J D mi+ iC/ e -i+ 1 • • • J D mi+m2 C/ e -i+^) x • • • 

x Tr( J D mi+ ... +mfc _ 1+1 f/^ + - + '" fe -i +1 • • ■D mi+ ... +mk U^-^)) 

= Wg(7V,7f).E(lV 77r -i(L>i,..., J D 2i )). 



Proof. Summations over r's and s's in the following formulas are from 
1 to N. 

E(Tr( J D 1 f/ ei • • • D mi U^)Tr(D mi+1 U^ +1 ■ ■ ■ D mi+m2 U e ^ + ^) 

• • • x Tr(D mi+ ... +mk _ 1+1 U e ^+-+^ +1 ■ ■ ■ D mi+ ... +mk U £ ^+-+^)) 

^V^si,^!) s 2 i,r l{ 2i)J V n,si J ^r 2 i,s 2 i) 

ri,-,r 2 i 
si,-..,S2i 

21 

= e e nw», w 8(*)- E (e-^i 



r l'-.»-2l weS W *=1 



2/ 



= E w g(-) E II <W™ • E • • • 

ff£S W n,...,r 2 , fc=l 

= V Wg(7r) V EfZ^W • • • D^ 2V> ) 

VV &1"; LJ \ J ^ri,r lW)) r 2 i,r^(2i))) 

= ^ Wg^E^^A,...,^)) 
= £ Wg^EClV^pi,...,^)) 



In the last equality we used that Wg(7r) depends only on the conjugacy 

claSS Of 7T. □ 
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Motivated by the result of Voiculescu |Voil| IVoi2j that Haar dis- 
tributed unitary random matrices and constant matrices are asymp- 
totically free, we want to investigate now the corresponding question 
for second order freeness. It will turn out that one can replace the 
constant matrices by another ensemble of random matrices, as long as 
those are independent from the unitary random matrices. Of course, 
we have to assume that the second ensemble has some asymptotic limit 
distribution. This is formalized in the following definition. Note that 
we make a quite strong requirement on the vanishing of the higher 
order cumulants. This is however in accordance with the observation 
that in many cases the unnormalized traces converge to Gaussian ran- 
dom variables. Of course, if we have a non-probabilistic ensemble of 
constant matrices, then the only requirement is the convergence of ki; 
all other cumulants are automatically zero. 

Definition 3.5. 1) Let {Ai, . . . , A s }n be a sequence of N x iV-random 
matrices. We say that they have a second order limit distribution if 
there exists a second order non-commutative probability space (A,<pi, 
(p 2 ) and Oi, . . . , a s G A such that for all polynomials Pi,p 2 , ... in s 
non-commuting indeterminates we have 

(9) lim ki(tr(pi(Ai, . . . , A s ))) = ip 1 (pi(a 1 , . . . ,a s )), 

(10) lim k 2 (Tr(p 1 (A 1 ,...,A a )),Tr(p 2 (A 1 ,...,A s ))) 

= V^PiOi, ■ • • ,a a ),p 2 (a 1 , . . . ,a s )), 

and, for r > 3, 

(11) lim k r (Tr(p 1 (A 1 ,...,A s )),...,Tr(p r (A 1 ,...,A s )))=0. 

2) We say that two sequences of Nx iV-random matrices, {A\, . . . , A s }n 
and {-Bi, . . . ,B t }^, are asymptotically free of second order if the se- 
quence {Ai, . . . , A s , Bi, . . . , B t }N has a second order limit distribution, 
given by (^4, (fx, ip 2 ) and a\, . . . ,a s ,b\, . . . ,b t G A, and if the unital 
algebras 

A := alg(l, ai, . . . , a s ) and A 2 := alg(l, b x , . . . , b t ) 
are free with respect to (<pi, <p 2 ). 

Notation 3.6. Fix m,n G N and let e : [l,m + n] — > {— 1,+1}. We 
defined S^ +n in Notation 13.11 for the case where Y^k=i e (^) = 0> as 
those permutations in S m+n for which e alternates cyclically between 
— 1 and +1 on all cycles. Note that this definition also makes sense 
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in the case where the sum of the e's is not equal to zero, then we just 
have S^+n — 0- Let t\ and e 2 be the restrictions of e to [l,m] and to 
[to + l,m + n], respectively. Then we put 

S%(m,n) := S^ +n n S NC (m,n) 

and 

NC {ei \m) := St ] n NC(m), NC {t2 \n) := fl NC(n). 

Theorem 3.7. Let {U}n be a sequence of Haar distributed unitary 
N x N -random matrices and {A ± , . . . , A S } N a sequence of N x N- 
random matrices which has a second order limit distribution, given by 
(A,(pi,ip2) and ai, ... ,a s e A. Furthermore, assume that {U}n and 
{Ai, . . . , A s }n are independent. Fix now to, n e N and consider poly- 
nomials Pi, ■ ■ ■ ,p m +n in s non-commuting indeterminates . If we put 
(for i = 1, . . . , to + n) 

Di := Pi(Ax, . . . , A 8 ) and d { := p,(ai, . . . ,a s ), 

then we have for all e(l), . . . , e(m + n) G { — 1, +1} £/ia£ 

(12) 

lim k 2 (Tr(D 1 U ei ■ ■ ■ D m U e ™), Tr(D m+1 U^ ■ ■ ■ D m+n U^)) 

= ^2 Vi™) ■ l Pl(lm,n^~ 1 )[dl, ■ ■ ■ ,d m +n] 

+ ^2 (^(TTl, 7T2) • flilm^l 1 X Tn^^Ml, • • • , ^m+n] 
7riGAfC*( £ i)(m) 
7r2eWC( e 2)(n) 

+ /i(7T 1 X 7T 2 ) • ^ 2 (7m7rr 1 >7n7T2" 1 )K, • • • ,<U.])' 

Note that in the case where the sum of the e's is different from zero 
this just states that the limit of k 2 vanishes. 

Proof. For notational convenience, we will sometimes write m + n = 21 
in the following, and also use 7 := 7 m , n . 
We have 

k 2 (TriD^ ■ ■ ■ D m U^), Ti(D m+1 U trn+1 ■ ■ ■ D 2l U^)) 
= E(Tr( J D 1 f/ ei • • • D m U e ™)Tr(D m+1 U e ™+ 1 ■ ■ ■ D 2l U e *)) 

- E(Tr( J D 1 f/ ei • • • D m U tm )) ■ E(Tr(D m+l U^ ■ ■ ■ D 2l U e *)) 

= Wg^.E^-i^x,...,^)) 
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- J2 Wg(7f 1 )Wg(^ 2 )-E(Tr 7wl ( J D 1) ... )J D m )) 

" e5 " 2) -E(T W (D m+1 ,...,^)) 
£ WgC^-E^-xp!,...,^)) 

7r connected 

+ £ ( W §(^ x *') • E(V^(A, ■ ■ ■ , D 2l )) 

- Wg(7f 1 )Wg(^ 2 )E(Tr 7m ^ 1 ( J D 1 , . . . , D n )) 

■E(Tr-,(D m+1 ,...,D 2l )) 



Note that if either m or n is odd then the last two terms are zero, 
which is consistent with equation p2jl . as in this case NC {ei) (m) and 
(n) are empty. So for the remainder of the proof we shall assume 
that m and n are even. 

The leading order in the first summand for a connected 7r is given 

by 

= iV^-H-^- 1 ! . . Eftr^-ip!, . . . , -D m +„)). 

Recall that, for a connected 7T, we always have 

m + n — \n\ — |77r _1 | < 0, 

and equality is exactly achieved in the case where ir is annular non- 
crossing. Thus, in the limit N — > oo the first sum gives the contribution 



We can rewrite the second sum as 

(13) £ {Wg(7fl X 7T 2 ) - Wg(7f 1 )Wg(^ 2 ; 

x E^^-ip!,..,^)) 
+ Wg(vf 1 )Wg(fr 2 ){E(Tr 7m ^ lx7 ^- 1 ( J D 1 , . . . , D m+n )) 
- E(Tr 7m ^- 1 ( J D 1 , . . . , D m )) • E(Tr 7nW - 1 ( J D m+1 , . . . , D m+n )) } 



16 J. A. MINGO, P. SNIADY, AND R. SPEICHER 

For a disconnected 71*1 x 7r 2 the leading orders in N of all relevant 
terms are given as follows: Wg(7Ti x n 2 ) and Wg(7fi)Wg(7r 2 ) both have 
leading order (note that // is multiplicative) 

^(^ 1 ) y u(7f 2 )iV~ (m+n)+#(7ri)+#(7r2) ; 
Ef^ip!, . . . , AO) • E(Tr 7 ^- 1 (D m+1 , . . . , D m+n )) and 
E ( Tr 7 m n- 1 x- fn n- 1 ( D u An+O) are both asymptotic to 

Wg(7Ti x 7r 2 ) — Wg(7fi)Wg(7r 2 ) has leading order 
M2(7fi,7r 2 ) ■ at-(-+«)+#(-i)+#(- 2 )-2. 

Now 

- (m + n) + #(7r x ) + #(tt 2 ) - 2 + #{ lm ^ x ) + #(7^) 
= _( m + 1 _ #( 7Fl ) _ #( 7m 7rr 1 )) - (n + 1 - #(vr 2 ) - frfr^ 1 )) < 

with equality only if both tti G NC^(m) and 7r 2 G A^C (e2) (n). 
Thus 

lim{Wg(7Ti X 7f 2 ) - Wg(7fi)Wg(7f 2 )}E(Tr 7m ,„ (7riX7r2) -i(A,...,£>rn+0 

( Tttx G NC^\m) 

_ I A*2(tti, (Tm^r 1 x 7 n 7r 5 T 1 )[di, . . . , d m+n ] < and 

[tt 2 G NC^(n) 
otherwise 

v 

To deal with the second term of the second sum ()13|) we will use the 
following notation. Let the cycles of 7 m 7rf 1 be C\ ■ ■ ■ c r and the cycles 
of 7n7r 2 ~ 1 be c r+ i ■ ■ ■ c r+s . Let = Tr Cj (A> • • ■ AO for 1 < i < r and 
bj = Ti Cr+] (D m+1 , D m+n ) for 1 < j < s. Then 

^(T^W 1 ^ 1 ' • • • » A0> Tr 7n ^-i(D m+1 , . . . , D m+n ) 

= k 2 (a 1 ■■■a r ,b 1 - • -b s ) 

So let us find for which 7Ti G Sm, vr 2 G S'n 2 '', and r G P(r + s) we 
have a non-zero limit of 

(14) Wg(#i) Wg(^ 2 ) k r ( ai , . . . , Or, h, . . . , b s ) 

As noted above the order of Wg(7fi) Wg(7f 2 ) is A^-( m+n )+#( 7ri )+#( 7r2 ). 
By equation (JTj) and the definition of a second order limit distribution, 
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k r (ai, . . . , a r , b%, . . . , b s ) is 0(N C ) where c is the number of singletons 
of r. Thus the order of (|14|) is 

-(m + n) + #(tti) + #(tt 2 ) + c 
= -(m + 1 - #(7n) - #(7m7rr 1 )) - (n + 1 - #(vr 2 ) - ^n^ 1 )) 
+ c + 2- (r + s) 

Hence fll4j) will vanish unless three conditions are satisfied: we must 
have that 7i"i and 7r 2 are non-crossing and c = r + s — 2, i.e. r has one 
pair and the rest of its blocks are singletons. 
Thus 

lim £ Wg(7h)Wg(7f 2 ) 

x k 2 (Tr 7m7r -a . . . , An), Tr w (D m+1 , . . . , 

7rieJVC( e i)(m) 
7r 2 eAfC*( E 2)(n) 

x limiV r+s ~ 2 2J k T (ai, . . . , a r , 61, . . . , b s ) 

where the r's in the sum have one pair and the remainder are singletons 
and r V l riS = l r+s . 

So the remainder of the proof is to show that 

limiV r+s - 2 k T (ai,...,a r , A) 

= f2(lm^l 1 ,ln^2 1 )[dl, ■ ■ ■ , d m+n ] 

where the sum runs over r's as above. 

Let r e V(r + s) be as above with pair where 1 < i < r and 
1 < j < s and all other blocks singletons. Then 

k r (ai, ...,a r ,bi,.. . ,b 8 ) 
= ki(ai) ■ ■ -ki(aj) ■ • • ki(a r )ki(6i) • ■ ■ki(fy) ■ ■ ■k 1 (b s )k 2 {a i ,b j ) 

where the hatted elements are deleted. So after multiplying by N r+S ~ 2 
and taking a limit we get (after omitting the arguments di, . . . , d m+n 
which are the same for each factor) 

Vi(ci) • ■■<fi(c i ) ■ ■ ■ <pi{c r )tpi(c r+ i) ■ ■•ip l {c r j r j) ■ ■■tpi(c r+s )(p 2 (c i ,c r+j ) 
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Now summing over all r, which is equivalent to summing over all i and 
j, we get via the derivation property of (p 2 (see equations (jlj) and (j3J)) 

^2(7 1 In^l ) [^1> ■ ■ ■ j ^m+n] 

as required. □ 

Remark 3.8. When all the D's are equal to 1, equation (jT2)l implies 
the following well known result of Diaconis and Shahshahani [DS] : for 
integers r and s 

(15) limk 2 (Tr(f/ r ),Tr(£/ s )) = \ ° , T ^ ~ S 

n I 7™ r = — s 

Indeed let m = \r\ and for 1 < i < m, let 6j = sgn(r), where sgn(r) 
denotes the sign of r; let n = \s\ and for m + 1 < i < m + ra, let 
6i = sgn(s). Then €\ H — • + e m +n = t + s. So if r + s 7^ then equation 
(pH2|) says that 

limk 2 (Tr(f/ r ),Tr(?7 s )) = 

Suppose that r + s = 0. The second term on the right hand side of (fH2j) 
is zero since both NC^ ei \m) and NC^ e2 \n) are empty. For the first 
term in (|12|) . note that the only elements of S^ c (m, n) which connect 
in this alternating way are pairings, where each block must contain one 
U and one U*. This forces m and n to be equal. In that case, we have 
the freedom of pairing the first U with any of the n U*'s. After this 
choice is made, the rest is determined. Thus there are n possibilities for 
such pairings. Since /i(7r) is always 1 for a pairing we get the claimed 
formula. □ 

Let e : [21] {-1,1} be such that J2f=i e * = °- For * e S$ 
let ff 6 Si be as in 3.1. A it- invariant partition A of [2/] gives A, 
a 7r-invariant partition of [I] as follows. For each block V of A let 
V = {k \ p k e V}, where we have used the notation of 3.1. Also each 
7r-invariant partition of [I] comes from a unique 7r-invariant partition 
of [21]. 

Let Mob be the Mobius function on the partially ordered set of par- 
titions of [I] ordered by inclusion. Let it E Si and A be a 7r-invariant 
partition of [I]. In (HI §2.3] Collins denotes the relative cumulant by 
CW.aCtt, N), which we will denote by CV 5 a- In our notation 



C nA = M6b(C,A)Wg(vr| yi )---Wg(7r| 



Ce[vr,A] 
C={Vi,...,V k } 
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where 7r|-^ denotes the restriction of tt to the invariant subset Vi and 
where necessary we have identified tt with the partition given by its 
cycles. Conversely given A = {Vi, . . . , V^} a 7r-invariant partition of [I] 
we write Wg yl (7r) for Wg(7r|y 1 ) • • • Wg(7r|y fe ). Then by Mobius inversion 
we have 

Wg A (7r)= C *.o 

C<=[n,A] 

Remark 3.9. When vr G S { 2 ? and A G V(2l) is 7r-invariant the equation 
above can also be written 

(16) Wg A (#)= Yl C *,c 

C<=[n,A] 

In (HI Cor. 2.9] Collins showed that the order of C~ q is at most 

jy-2Z-#(7r)+2#(C)_ 

In the following we address the estimates for higher order cumulants, 
k r for r > 3. 

If Di, . . . ,D 2 i are random matrices and tt G S21 is a permutation 
with cycle structure tt — TT\ x • • - x ir r with 7Tj = (71^1, . . . , KiM)) we 
denote 

^(Di, ...,£),) = k r (Tr(D ni l ■ ■ ■ D^ ^), Tr(D n21 ■ ■ ■ D„ am ), ...). 

When A = {Ax, . . . , Ak} is a 7r-invariant partition of [2/] we can write 
71 = tt\ x ■ • • x 71 k where 7ii = 7t|a 4 is a permutation of the set Ai. We 
denote the multiplicative extension of by 

KA D u ■ • • , D 2l ) = k Wl {Dt,... , D 2 i) ■■■K k (D 1 ,..., D 2J ) 
Mobius inversion gives us that 

E(Tr 7r (D 1 , . . . , D 2i )) = ^ W(D 1; . . . , D 2/ ) 

AeP(2Z) 

A 7r-inv. 

where the sums run over all 7r-invariant partitions A in V(2l). 

Theorem 3.10. Let {U}n be a sequence of Haar distributed unitary 
N x N -random matrices and {A\, . . . , A s }jst a sequence of N x N- 
random matrices which has a second order limit distribution, given by 
(A,<pi,<p2) an d a\,...,a s G A. Furthermore, assume that {U}n and 
{Ai, . . . , A s }n are independent. 

Suppose r > 1 and mi, ■ • ■ , m r are positive integers such that m\ + 
• • • + m r = 21 and ei, . . . , t^i G { — 1, +1} are such that Yui=i e « = ®- 
Consider polynomials pi, ■ ■ ■ ,P2i in s non-commuting indeterminates . 
For i — 1, ... ,21 we set 
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A := Pi(Ai, . . . , A s ) 

and for 1 < i < r let 

y _ t<( n 7-re(miH hrrij-i+l) r) jje{m 1 -\ \-m,i)\ 

■A-i — lr ^mH hm 4 _i+l^ -^miH hm,^ J 

(17) k r (X 1 ,...,X r )= E JC^V*-,^), 

7r6i " AvB=l (1 , 2i] 

where the second sum runs over pairs (A, B) of partitions of [1,2/] 
snc/i £/ia£ A 7r -invariant and B is ^n" 1 -invariant and furthermore 
AV B = l [m . 

Secondly, we have for r > 3 that 

(18) lim k r (X 1 ,...,X r ) =0. 

N— »oo 

If we have mi, . . . , m r for which m 1 + • ■ • + m r is odd or e±, ... ,€21 for 
which Ylf=i e i 7^ then k r (Xi, . . . , X r ) = 0. 

Proof. In order to simplify the writing we shall write D for (Di, . . . , 
Z?2j). Let Ii be the interval [mi + • — h m^i + 1, mH — • + and for 
any subset V C [r], iy = UjgyJj. 

If C = {Vi, . . . , 14} is a partition of [r] we let Sy^ the set of permu- 
tations of 1^ that take e _1 (l) Hiy onto e _1 (— 1) fliy. If these two sets 
have different cardinalities then Sy is empty. Let lc be the partition 
{Ivu ■ ■ ■ , Iv k } of [2/]- Let 7j be the cyclic permutation of Ii given by 
(mi H h wij-i + 1, . . . , mi H h m*) 

With this notation 

Ec(Xi> • • • ,-^r) = Eyi(^i, • • • ,X r ) ■ ■ - E Vk (Xi, . . . ,X r ) 
= E'"E Wg(^i)--.Wg(^)E(T W (D)).-.E(T W p)) 



^ Wg^fflEcCliv-i^)) 



l c 7r-inv. 



E E c'm E ^-.b^) 



7T 



eS (0 Ag[7r,l c ] Be-P(2Z) 



l c 7r-inv. B 7^ Mnv. 

Thus 

k r (Xi, . . . , X r ) 
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= M6b(C,l r )E c {X 1 ,...X r ) 

= Yl M6b(L7,l r ) Y E C *t E ^~\b{D) 

C&V(r) weS M A6[ir,l ] BeP(2i) 

l C 7r-inv. B 7T" 1 -inv. 

= E E E E Mob((7, 10^1^-^(5) 

lci"-inv. B 77r- 1 -inv. 

= E E E E Mob^i^c^v-s^^) 

ff6S <j) Ae7»(20 flePfai) cep(r) 

7r-inv. B 77r _1 -inv. A,B<1q 

= E E ^aV^) 

AvB=l 2i 

where the sum is over all A and B which are ir and 77r~ 1 -invariant 
respectively. The last equality followed from the identity 



M6b(C,l r 



CG-P(r) 
A,B<1 C 



1 A V B = hi 

otherwise 



This proves (|T7jl . 

We know that the order of C-^ is N' 21 '*^ 2 *^ . Let C; be the 
number of blocks of B that contain i cycles of 771" -1 . By our assumption 
on the second order limiting distribution of {Ax, . . . , A S } N 



^n- l ,B 



0(iV Cl ) c 3 + c 4 + --- = 
o(iV Cl ) c 3 + c 4 + --->0 



Suppose first that C3 + C4 + ■ • ■ > 0. Then 

E ic i = ( C 2 + C 3 + •••)+ E^ - ^ 1 + - #{B) 

i>2 i>l 

So 

Ci = #(7vr- 1 )-^^<#( J B)-1 

i>2 

By Lemma Q(l), + #(5) < 2/ + 1. Thus 

-2/ - #(tt) + 2#(A) + d < -21 - #(tt) + 2#(A) + #(5) - 1 < 
Hence C- ^ ■ k J7r -i(D) = o(N°) as required. 
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So now suppose that c 3 + c 4 + ■ • • = 0. Then #(771 x ) 
In this case 

C M • k^-i(D) = o(N- 2l -*^ +2 #^ +c ^ 
and thus it remains to show that 

(19) -21 - #(tt) + 2#(A) + d < 2 - r 
Note that 

|(l 2 ,,7)|=2|l 2l |-|7| = 2Z-2 + r, 
|(A tt)| = 2\A\ - |tt| = 2/ - 2#(A) + #(tt) 

and 

I (B, 77r -1 ) I = 2|S| - I77T- 1 ! = 2/ - 2#(B) + #(77^) 
So by Lemma O (2) 

(20) 2(#(A) + #(5)) - 2/ - #(tt) - #(77^) < 2 - r 
However 

2^(B) - #( 7 7T- 1 ) = #(£?) - C 2 = Cl 

together with (|2Uj) proves (fT9")) □ 

Remark 3.11. As a corollary of Theorem 13 . 1 01 we obtain that if {U}n 
is a sequence of Haar distributed unitary random matrices, then {U}n 
has a second order limit distribution given by equation ()15|). Indeed, 
relative to E(Tr(-)), [/ is already a Haar unitary so condition (jUJ) of 
Definition 13.51 is satisfied. We have observed in Remark 13.81 that condi- 
tion (|10|) is satisfied and by Theorem 13 . 101 above we have that condition 
(fTTj) is satisfied. 

Then {U}n has a second order limit distribution which is given by 

(21) \im k 2 (Ti(U ei ■ ■ ■ U 6m ), Tr([/ €m+1 ■ ■ ■ U em+n )) 

Y Y ^2(^1^2) 

Combining this formula with equation ()15j) allows one to derive the 
values of /x 2 - These kind of questions will be considered elsewhere. 

□ 

Theorem 3.12. Let {U}n be a sequence of Haar distributed unitary 
NxN random matrices and {Ax, . . . , A s }n a sequence of Nx N random 
matrices which has a second order limit distribution. If {U}n and 
{Ai,...,A s } N are independent, then they are asymptotically free of 
second order. 



= c 2 + #(£). 
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Proof. The asymptotic freeness with respect to ki(tr(-)) is essentially 
the same argument as Voiculescu's proof |VoiH IVoi2j for the case of 
constant matrices, see also the proof of Collins [d • 

Theorem 13. 1UI provides the bound on higher order cumulants so we 
need to prove now only the second order statement. 

We have to consider cyclically alternating and centered words in 
the U's and the A's. For the IPs, every centered word is a linear 
combination of non-trivial powers of U, thus it suffices to consider such 
powers. Thus we have to look at expressions of the form 

(22) k 2 (T±(B 1 U i W ■ ■ • B p U i{p) ), Ti{U j{r) C r ■ ■ ■ U j{1) d)), 

where the -B's and the C's are centered polynomials in the A's and 
i(l)> • • • , i(p),j(l), . . . ,j(r) are integers different from zero. We have 
to show that in the limit N — > 00 the expression (}2*2*|) converges to 
(23) 

p-i 

fc=0 

We can bring the expression (|22j) into the form considered in Theorem 
13.71 bv inserting l's between neighbouring factors U or neighbouring 
factors U*. If we relabel the -B's, C's, and l's as .D's then we have to 
look at the following situation: For polynomials pi in s non-commuting 
indeterminates we consider 

A :=p i (A 1 ,...,A s ), 

which are either asymptotically centered or equal to 1. The latter 
case can only appear if we have cyclically the pattern . . . UDiU ... or 
. . . U*DiU* .... Formally, this means: 

• if e 7 -i(i) = Q then either £)$ = 1 (for all N, i.e., Pi = 1) or 

\im ki(tr [£)<]) = 0. 

• if e 7 -i(j) 7^ €i then 

\im ki(tr[A]) = 0. 
We can now use Theorem 13. 71 for calculating the limit 

lim k^Trp^ 1 • • ■ D m U^),Ti(D m+1 U^ ■ ■ ■ D m+n U em+ ")) , 

and we will argue that most terms appearing there will vanish. First 
consider the last two sums in equation (JT5J), corresponding to tti G 
NC(m) and 7r 2 G NC{n). Since 7Ti is non-crossing we have that #(7Ti) + 
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^(im^i 1 ) =m + l. Since each cycle of 7Tl must contain at least one U 
and one U*, we have 

which implies ifijm^i) > m/2 + 1. However, this can only be true if 
7m 7r i contains at least two singletons. Note that if (1) is a singleton 
of 7 m 7rj~ 1 and if we have D^ — l for that z, then we have 

Im^ii) = i, thus = J~ X (i) = T 1 ^), 

and hence 

V'W = VHO = e *' 
which is not allowed because tt± is from NC^ ei \m), i.e., it must connect 
alternatingly U with Z7*. Hence D t 7^ 1 and so </?i(dj) = lini/v ki(tr(.Dj)) 
= 0. Thus, both 

) [^1; • • • 1 d m +n\ 

and 

^2(7 m^"l j 7n^2 ) [^1> • • • ) ^m+n] 

are zero, because at least one singleton (i) gives the contribution ip\{di) 
= 0. 

Consider now the first summand of equation (fP2|). Suppose 7r G 
5^(971, n). Let us again put 7 := 7 m , n . Since 7r is annular non-crossing 
we have 

\n\ + |77T _1 | = m + n, 

or 

#( 7r ) + #( 7 7r- 1 ) =m + n. 
Again, each cycle of it must contain at least two elements, i.e., 

m + n 
#(?r) < — , 

thus 

#(tO> 2 - 

If 77T -1 has a singleton (z), then this will contribute <fx(di) and since, 
as above the case dj = 1 is excluded for a singleton, we get a van- 
ishing contribution in this case. This implies that, in order to get a 
non-vanishing contribution, 77r~ 1 must contain no singletons, which, 
however, means that we must have 

,, , _i N m + n , . , ,., . rrt + n 

#(77r ) = — - — , and thus also #( 7r ) = — - — 

i.e., all cycles of 77r _1 and of 7r contain exactly two elements. This, 
however, can only be the case if each cycle connects one point on the 
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outer circle to one point on the inner circle. Being non-crossing fixes 
the permutation up to a rotation of the inner circle. Thus, in order to 
get a non-vanishing contribution, we need m = n and 

tt = (1, 7 fe (2n))(2, 1 k (2n - 1)), . . . , (n, ^{n + 1)) 

for some k = 0, 1, . . . ,n — 1. Note that 7r must always couple a U with a 
U* and the factor h(tt) is always 1 for such pairings. This gives exactly 
the contribution as needed for second order freeness. □ 

Of course, a natural question in this context is how the result of Di- 
aconis and Shahshahani (Remark l3.8j) generalizes to the case of several 
independent unitary random matrices. Note that as we have estab- 
lished the existence of a second order limit distribution for Haar dis- 
tributed unitary random matrices we can use an independent copy of 
them as the ensemble {Ai, . . . , A s } in our Theorem 13.121 By Remark 
12.71 this can be iterated to give the following. 

Theorem 3.13. Let {U^}n, • • • , {U^'}n be r sequences of Haar dis- 
tributed unitary N x N -random matrices. If {U^}n, • • • , {U^}n are 
independent, then they are asymptotically free of second order. 

This contains the information about the fluctuation of several inde- 
pendent Haar distributed unitary random matrices. Again, it suffices 
to consider traces of reduced words in our random matrices, i.e., ex- 
pressions of the form 

(24) Tr(^«...^) 

for n G N, and k(r) G Z\{0} and z(r) ^ i(r + 1) for all r = 1, . . . ,n 
(where i(n + 1) = «(1)). But these are now products in cyclically 
alternating and centered variables, so that by the very definition of 
second order freeness we get 

(25) Jim k 2 (Tr(^ ■ • • U*$), Tr(U™ ■ ■ ■ C$>)) 

71-1 

- o mn <pi {U l{1) u j{1+r) ) -~<pi [u i{n) u j{n+r) ). 

r=Q 

The contribution of <p\ in these terms vanishes unless the matrices and 
their powers match. Note also that the vanishing of higher cumulants 
can be rephrased in a more probabilistic language by saying that the 
random variables (J24)) converge to a Gaussian family. 

Corollary 3.14. Let {U^}n, • • • , {U( r )}N be independent sequences of 
Haar distributed unitary N x N -random matrices. Then, the collection 
p^P of unnormalized traces in cyclically reduced words in these random 
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matrices converges to a Gaussian family of centered random variables 
whose covariance is given by the number of matchings between the two 
reduced words, 

(26) 

Um k 2 (Tr(^W . . . ogf ) , Tr(U™ ■ ■ ■ !$>)) 

= S mn • #{r E {l,...,n} \ i(s) = j(s + r), 

fe(s) = -Z(s + r) Vs = l,...,n} 

This result was also obtained independently in the recent work of 
Radulescu [Rj around Connes's embedding problem. 

The following theorem gives an easy way to construct families of 
random matrices which are asymptotically free of second order. 

Theorem 3.15. Let {U}n be a sequence of Haar distributed unitary 
N x N -random matrices. Suppose that {Ax, . . . , A s }n and {Bx, . . . , 
Bi}n are sequences of N x N random matrices each of which has a 
second order limit distribution. Furthermore, assume that {Ax, . . . , 
A s }n, {Bi, . . . , B t }N, and {U}n are independent. Then the sequences 
{Ai, . . . , A s }n and {UBiU* , . . . ,UB t U*}N are asymptotically free of 
second order. 

Proof. The proof is a repetition of the proof of Theorem 13.121 except 
that we cannot assume that {Ax, . . . , A s , Bx, . . . , B t } N has a second 
order limit distribution. Instead we have the independence of the Ai 
from the B^s and a special e. So we shall only indicate how the proof 
has to be modified. 

The first order freeness follows as in the proof of Theorem 13.121 In 
the proofs of Theorems 13 . 71 l3~TUl and !3.12l the cumulants we need are all 
sums over for various n's. Now we have a special form of e, namely 
£j = (— Thus if 7r G if>2„ then 7r takes even numbers to odd num- 
bers and vice versa. Since the same applies to any of the 7's, we have 
that 771" -1 takes even numbers to even numbers and odd numbers to 
odd numbers. Thus the orbits of 77r _1 consist either of all odd numbers 
or of all even numbers. Hence if Pi, . . . , P n are words in Ax, ■ ■ ■ , A s and 
Qx, ■ ■ ■ ,Q n are words in Bx, ... , B t , then by the independence of the 
A's and the B's 

E(Tr J7r -i{Px,Qx,...,P n ,Qn)) 

= E(Tr(Wx) • • ■ Tr(WA) ■ E(Tr(W j+1 ) ■ ■ ■ Tr(W k )) 

where k = #(7vr -1 ) and Wi for 1 < % < j is a word only in A's and 
for j + l<i<A;isa word only in B's. This means that as far as 
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the asymptotic behaviour of E(Tr 77r -i (Pi, Q 1 , . . . , P n , Q n )) is concerned 
we may assume that {Ai, . . . , A s , Bi, . . . , B t } n has a second order limit 
distribution. Hence our claim follows from Theorem 13.121 □ 

We say that a tuple {B±, . . . , B s } of iVx iV-random matrices is U(N)- 
invariant if for every U G U(N) the joint probability distribution of 
the random matrices {B±, . . . , B s } coincides with the joint probability 
distribution of the random matrices {UBiU*, . . . , UB S U*}. 

Corollary 3.16. Let {Ax, . . . , A s }n be a sequence of N x iV '-random 
matrices which has a second order limit distribution and let {B\, . . . , 
Bt}N be a sequence of U(N) -invariant N x N -random matrices which 
has a second order limit distribution. Furthermore assume that the ma- 
trices {Ai, . . . , A S } N and the matrices {B ly . . . , B t } N are independent. 
Then the sequences {A ly . . . , A S } N and {B x , . . . , B t } N are asymptoti- 
cally free of second order. 

4. Failure of Universality for multi-matrix models 

In this section we want to make the meaning of second order freeness 
for fluctuations of random matrices more explicit and relate this with 
the question of universality of such fluctuations. There has been much 
interest in global fluctuations of random matrices, in particular, since 
it was observed that for large classes of one-matrix models these fluctu- 
ations are universal. In the physical literature this observation goes at 
least back to Politzer jPj, culminating in the paper of Ambj0rn et al. 
AJMj . whereas a proof on the mathematical level of rigour is due to 
Johansson [J] . Universality for one- matrix models lets one expect that 
one would also have such universality for multi-matrix models. Indeed, 
this expectation was one of the starting points of our investigations. 
However, our machinery around second order freeness shows that such 
universality is not present in multi-matrix models. 

Before we address multi-matrix models let us first recall the relevant 
result of Johansson [J] . We consider Hermitian iV x iV-random matrices 
A = (aij)^j =1 equipped with the probability measure 

(27) dfi N (A) = ^exp{-NTr[P(A)}}dA, 

where 

N 

dA = j j d Re ajj d Im a^- J^J dan. 

l<i<j<N i=l 

Here, P is a polynomial in one variable, which we will address as "po- 
tential" in the following, and is a normalization constant. If one 
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restricts to a special class V of potentials P (the most important con- 
dition being that the limit eigenvalue distribution has a single interval 
as support - which we normalize in the following to [—2,2]) then Jo- 
hansson proved the following universality of fluctuations for this class: 
Consider the sequence of N x iV-random matrices {An}n given by (|2~7jl . 
Then this sequence has a second order limit distribution which can be 
described as follows: 

(1) We have 

lim ki{tr[A£]} = / t n du P (t) (n G N), 

N-*oo J 

where vp is a probability measure on R ("limiting eigenvalue 
distribution") which is given as the solution of the singular in- 
tegral equation 

(28) f = -\p'{s) for all s G supp v P . 
J t s 2 

(2) Let T n (n G N) be the Chebyshev polynomials of first kind 
(which are the orthogonal polynomials with respect to the arc- 
sine law on [—2,2]). Then 

lim k 2 {Tr[T n (y4 Ar )],Tr[T m (^ A r)]} = 5 mn ■ n. 

N— >oo 

Whereas the limiting eigenvalue distribution vp depends on the form 
of the potential P, the fluctuations are the same for all potentials in 
the class V - they are always diagonalized by the same polynomials 
{T n | n G N}. Note that the most prominent example for the considered 
class of random matrices is given by P(A) = A 2 , which corresponds 
to the Gaussian random matrix ensemble. So one can phrase this uni- 
versality also in the way that all considered random matrices have the 
same fluctuations as Gaussian random matrices (but their eigenvalue 
distributions are of course different from Wigner's semi-circle law). 

Let us now consider multi-matrix models. For notational convenience 
we restrict to the case of two-matrix models. Take now a polynomial 
P(A, B) in two non-commuting variables and consider pairs of hermit- 
ian N x iV-matrices A = (oy)£l- =1 and B = (6y)^- =1 equipped with the 
probability measure 

(29) dfji N {A, B) = ^— exp{-A^Tr[P(A, B)]}dAdB, 

Z N 

where is a normalization constant. The simplest ensemble of this 
kind is the case of two independent Gaussian random matrices which 
corresponds to the choice P(A,B) = A 2 + B 2 . The above mentioned 
universality result for the one-matrix case lets one expect that one 
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might also have universality for multi-matrix ensembles which are close 
to the ensemble of independent Gaussian random matrices. How- 
ever, we will now show that even restricted to potentials of the form 
P(A, B) = P\{A) + P2{B) we do not have universal fluctuations. 

Let us first observe that our concept of second order freeness tells 
us how to diagonalize fluctuations. We spell this out in the following 
theorem which is an easy consequence of Definition ^. 5l of second order 
freeness. 

Theorem 4.1. Let {^4^}^ and {Bn}n be two sequences of N x N- 
random matrices which are asymptotically free of second order. Let 
{Qn \n eN} and {Q„ \ n G N} be the orthogonal polynomials for the 
limiting eigenvalue distribution of An and Bn, respectively, determined 
by the requirements that and are polynomials of degree n and 
that 

lim ki{tr[Q^(A JV )Q^(A JV )]} = 5 nm , 

iV^oo 

lim kx{tr[Qf (B N )Q*(B N )]} = 5 nm . 

iV— >oo 

Then the fluctuations of mixed traces in An and Bn are diagonalized 
by cyclically alternating products of and and the covariances 
are given by the number of cyclic matchings of these products: 

lim^k 2 {Tr[Qt {1) (A N )Qf (1) (B N ) • ■ ■ Q? {m) (A N )Qf {m) (B N )], 

Tr[Qf [n) (B N )Qi in) (A N ) ■ ■■Q? il) (B N )Qi (1) (A N )}} 
= <W#{?" G {1, . . . ,n}\i(s) = k(s+r),j(s) = l(s+r) Vs = 1, . . . ,n} 

To come back to our problem of universality for multi-matrix mod- 
els we only have to observe that Corollary 13.161 tells us that we have 
asymptotic freeness of second order if we choose a potential of the form 
P(A,B)=P 1 (A) + P 2 (B). 

Theorem 4.2. Let P(A,B) = P^A) + P 2 (B) where P x and P 2 are 
polynomials from the class V. Consider the two-matrix model {An, 
Bn}n given by the probability measure / T^j) . Let v\ and v 2 be the 
limiting eigenvalue distribution for P\ andP 2 , respectively (as described 
in Eq. and denote by {Q^ \ n G N} and {Q 2 n \ n G N} the 

respective orthogonal polynomials. Then the sequence {A N , B n }n has 
a second order limit distribution given by (A, ip±, <p 2 ) and a,b G A which 
can be described as follows: 

(1) (pi is the free product of v\ and v 2 . 

(2) (f 2 is diagonalized by the following collection of polynomials: 

{T n (a) | n G N} 
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{T n (b) | n e N} 

{Q\i)^)Qh)( b )---Q\n)(a)Q 2 ]{n) (b)}, 

where in the last set we choose one representative from each 
cyclic equivalence class, i.e. for all n G N, n-tuples ((i(l), j(l)), 
. . . , (i(n),j(n))) which are different modulo cyclic rotation 

Proof. Note that the additive form of the potential P(A, B) = Pi(A) + 
P 2 (P) means that An and Bn are independent, An is a one-matrix 
ensemble corresponding, via pTj) . to a potential Pi, and Bn is a one- 
matrix ensemble corresponding to a potential P2- Thus the statement 
about the diagonalizing polynomials in either only An or in only Bn 
is just Johansson's result. For getting the statement about the diag- 
onalizing polynomials in both An and Bn we have to note that the 
random matrices An (and also Bn) are W(iV)-invariant, thus Corol- 
lary EHH implies that {An}n and {Bn}n are asymptotically free of 
second order. Hence we can apply Theorem 14. II above. □ 

Note that whereas the polynomials in only one of the matrices are 
universal (namely equal to the Chebyshev polynomials {T n } n ), the 
polynomials which involve both matrices are not universal but depend 
on the eigenvalue distributions v\ and i^. Since the latter vary with 
the potentials P\ and P 2 , the polynomials Q\ and Q\, and thus also 
the alternating products in them, depend on the choice of P. Thus 
we can conclude that even within the very restricted class of P's of 
the form P(A, B) = P\{A) + P 2 (P) we have no universality of global 
fluctuations in multi-matrix models. 
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